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TITLE OF THE INVENTION 



IMAGE PROCESSING METHOD, IMAGE PROCESSING APPARATUS, AND 

PRINTING APPARATUS 



BACKGROUND OF THE INVENTION 



Field of the Invention 

[0001] The present invention relates to an image 
10 processing method, an image processing apparatus, and a 

printing apparatus for printing out a plurality of images 
obtained from moving image data. 
Description of the Related Art 

[0002] A conventional system is proposed for cutting out 
15 a plurality of still images from a moving image file and for 

printing the cut-out still images onto sheets like oblong 
cards so as to provide a printing material by which a pseudo 
moving image can be observed by turning the sheets like the 
oblong cards as shown in Fig. 15 (hereinbelow, the above- 
2 0 mentioned moving image is referred to as a "turning moving- 

image n , and the still images for providing the turning 
moving-image are referred to as "continuous still images"). 
In the system, frames from a start image designated by means 
for designating the start image from the moving image file 
25 to an end image designated by means for designating the end 
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image are cut out at a predetermined interval, thereby 
obtaining the continuous still images. The obtained 
continuous still images are printed, thereby providing the 
printing material which enables the enjoyment of the 
5 "turning moving-image". 

[0003] However, since the "turning moving-image" 
including the moving image file is conventionally enjoyed at 
the predetermined interval, obviously, the moving image with 
small motion becomes the "turning moving-image" with the 
10 small motion. 

[0004] It is an object of the present invention to 
generate the continuous still images by using an trimming 
area to be extracted from the frames in consideration of the 
above problems . 

15 

SUMMARY OF THE INVENTION 

[0005] There is provided an image processing apparatus 
comprising: designating means which designates a desired 

20 range of moving image data; designating means which 

designates trimming areas of at least two frames from a 
predetermined number of frames to be cut out from the range 
designated by the designating means; setting means which 
sets the trimming areas of the predetermined number of 

25 frames to be cut out based on the trimming areas designated 
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by the designating means; generating means which cuts out 
the predetermined number of frames from the range designated 
by the designating means, extracts the trimming areas set by 
the setting means, and generates a predetermined number of 
5 continuous still images; and printing control means which 

prints the continuous still images generated by the 
generating means, 

[0006] Further objects, features and advantages of the 
present invention will become apparent from the following 
10 description of the preferred embodiments (with reference to 

the attached drawings) . 

BRIEF DESCRIPTION OF THE DRAWINGS 

15 [0007] Fig. 1 is a block diagram showing the structure of 

an image forming system according to an embodiment of the 
present invention . 

[0008] Fig. 2 is a diagram for explaining an information 
processing device 100 in the image forming system shown in 

20 Fig. 1 in views of the software structure. 

[0009] Fig. 3 is a flowchart for explaining processing 
executed when a sheet selecting screen is selected. 
[0010] Fig. 4 is a flowchart for explaining processing 
executed when a moving image selecting screen is selected. 

25 [0011] Fig. 5A is a flowchart for explaining processing 



when a range setting screen is selected. 

[0012] Fig. 5B is a flowchart for explaining processing 
for setting a visual effect. 

[0013] Fig. 6 is a flowchart for explaining processing 
executed when a printing and storing screen is selected. 

[0014] Fig. 7 is a diagram showing a display example of a 
sheet selecting screen. 

[0015] Fig. 8 is a diagram showing a display example of a 
moving image selecting screen. 

[0016] Fig. 9A is a diagram showing one display example 
of a range setting screen. 

[0017] Fig. 9B is a diagram showing another display 
example of the range setting screen. 

[0018] Fig. 10A is a diagram showing a display example of 
a printing and storing screen. 

[0019] Fig. 10B is a diagram showing a printing-out 
example . 

[0020] Fig. 11 is a diagram showing the setting of a 

trimming area when the zoom-in operation is set. 

[0021] Fig. 12 is a diagram showing the setting of the 

trimming area when a camera pan effect is set. 

[0022] Fig. 13 is a diagram for explaining the movement 

and the size change of the trimming area. 

[0023] Fig. 14 is a diagram for explaining the setting of 
a form for changing the size of the trimming area and a form 



for changing the position thereof. 

[0024] Fig. 15 is a diagram for explaining a state in 
which a turning moving-image is observed. 



DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[0025] Hereinbelow, a description is given of a preferred 
embodiment of the present invention with reference to the 
attached drawings. 

[System structure] 

[0026] Fig. 1 is a block diagram showing the structure of 
an image forming system according to the embodiment of the 
present invention. The image forming system according to 
the embodiment comprises an information processing device 
100 for generating print data (including a control command) 
and a printer 170 for foxming an image based on the print 
data . 

[0027] The information processing device 100 comprises: a 
memory 110/ a CPU 130; a hard disk controller (HDC) 120; a 
hard disk (HD) 121 connected to the HDC 120; a floppy 

(registered trademark) disk drive (FD) 126; a printer 
controller (PRTC) 140; a keyboard/pointing device controller 

(KB/PDC) 150; a keyboard (KB) and pointing device (PD) 151 
connected to the KB/PDC 150; a CRT controller (CRTC) 160; 
and a CRT 161 connected to the CRTC 160. 
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[0028] A mouse is used as the pointing device (PD) 
according to the embodiment. However, various devices such 
as a track ball and a touch panel are used as the PD. The 
CRT 161 is used as a display device in the above structure. 
Obviously, another-type display device, e.g., a liquid 
crystal display device and a plasma display device may be 
used as the display device. 

[0029] The memory 110 comprises: application 111 for 
processing for image editing according to the embodiment; a 
printer driver 112 as software for generating print data 
corresponding to the printer 170; a spooler area 113 for 
spooling the print data to be supplied to the printer 170; 
an OS (Operating System) (not shown); a work area; and the 
like . 

[0030] The CPU 130 is operated based on the application 
111, the printer driver 112, and the OS in the memory 110. 
Incidentally, the CPU 130 is booted by a boot program stored 
in a ROM (not shown) upon turning on power, an OS program is 
loaded to the memory 110 from the HD 121, and the OS is 
started. Subsequently, the application programs are loaded 
under the control of the OS and then are executed. 
Consequently, the CPU 130 functions as an image forming 
system. Of course, the CPU 130 can access the HD 121 via 
the HDC 120. 

[0031] The PRTC 140 sequentially transmits, to the 



printer 170, the print data stored in the spooler area 113. 
The KB/PDC 150 controls the KB/PD 151 and captures 
instruction data from a user into the information processing 
device 100. The CRTC 160 is a controller which controls the 
CRT 161 as the display device. The KB/PDC 150, the KB/PD 
151, the CRTC 160, and the CRT 161 form user interfaces. 
[0032] The printer 170 comprises: an interface 171 for 
receiving the print data from the information processing 
device 100 and for sending notifications indicating various 
statuses to the information processing device 100; a printer 
control unit 172 for interpreting, mainly, the received 
print data and for generating bit map image data; and a 
printer engine 173 for receiving the bit map image data 
outputted from the printer control unit 172 and forming an 
actual image. Further, the printer 170 comprises an 
operation panel (not shown), etc. The printer engine 173 
may use any system such as an ink-jet system, a digital 
photography system, and a thermal system. 
[0033] When the printer 170 is connected to the 
information processing device 100 with the above-described 
structure, first, it is necessary to install the printer 
driver for generating the print data corresponding to the 
printer 170. Of course, the install operation may usually 
be performed once except for extraordinal reason. 
[0034] Fig. 2 is a diagram for explaining the information 
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processing device 100 in the image forming system shown in 
Fig. 1 in views of the software structure. 

[0035] The keyboard or mouse (KB/PD) 151 is connected to 
the information processing device 100 as an input device. 
5 The CRT 161 as a monitor and the printer 170 as output 

devices are connected to the information processing device 
100. 

[0036] A keyboard/mouse driver 182 processes the input 
through the keyboard or the mouse and the processed input is 

10 transmitted to an OS 180. The information processing device 

100 has application software 101 such as a word processor, 
spreadsheet, and Internet browser. Various drawing commands 
(image drawing command, text drawing command, and graphics 
drawing command) indicating an output image issued by the 

15 application software 101 are inputted to a monitor driver 

181 via the OS 180. Upon printing, the drawing commands are 
inputted to the printer driver 112 via the OS 180. The 
printer driver 112 is software which processes the drawing 
commands, forms the print data, and prints the data on the 

20 printer 170. The monitor driver 181 is software which 

displays the image on the CRT 161. 

[0037] As the information processing device 100 shown in 
Figs. 1 and 2, a personal computer of the IBM AT compatible 
machine which is generally spread is used. As the OS 180, 
25 Windows 98 (registered trademark) produced by Microsoft 



Corporation is used. The monitor 106, the printer 105, and 
the keyboard mouse 112 are connected to the personal 
computer and printing processing application, which will be 
described later, is executed, thereby realizing the printing 
system according to the embodiment. 

[0038] In the information processing device 100, the 
application software 111 forms output image data by using 
text data, graphics data, and image data which are 
classified into text, e.g., characters, graphics, e.g., 
drawing, and photographic image. Upon printing the image 
based on the output image data, the application software 111 
requests a printing output to the OS 180, and issues, to the 
OS 180, drawings commands including a text drawing command 
corresponding to a text data portion, a graphics drawing 
command corresponding to a graphic data portion, and an 
image drawing command corresponding to an image data portion. 
[0039] The OS 180 receives the request for the printing 
output from the application software 111 and, then, 
transmits the drawing commands to the printer driver 112 
corresponding to the printer 170. The printer driver 112 
processes the request for the printing output and the 
drawing commands transmitted from the OS 180, forms the 
print data which can be printed by the printer 170, and 
sends the printer 170 to the print data. 
[0040] When the printer 170 is a raster printer, the 



printer driver 112 sequentially rasterizes the drawing 
commands to a band memory having each 8-bit depth of RGB. 
After rasterizing all the drawing commands, contents of a 
page memory are converted into data in a printable data 
format, e.g., CMYK data, and transmits the converted data to 
the printer 170. The band memory is assigned to the RAM 
(memory 110) . 

[Printing processing application] 
[0041] Next, a description is given of printing 
processing application operable as the application 111 
according to the embodiment. The printing processing 
application according to the embodiment extracts a 
predetermined number of continuous still images from a 
desired range of the moving image data, and prints the 
continuous still images onto a perforated sheet which can be 
cut out like oblong cards, as shown in Fig. 10B. By 
printing the continuous still images and margins in the 
longitudinal direction of the sheets like the oblong cards 
in parallel therewith, the sheets like the oblong cards have 
gutters. The thus-obtained sheets like the oblong cards are 
bound and the turning moving-images are observed by handling 
the sheets like the oblong cards as shown in Fig. 15. A 
detailed description is given of the operation and functions 
of the printing processing application according to the 
embodiment . 



[0042] The printing processing application according to 
the embodiment is started and, then, a dedicated application 
window is displayed. The application window includes a 
sheet selecting screen (refer to Fig. 7), a moving image 
selecting screen (refer to Fig. 8), a range setting screen 

(refer to Figs. 9A and 9B) , and a printing and storing 
screen (refer to Fig. 10A) . When the printing application 
is started, the sheet selecting window is displayed as an 
initial screen. However, the present invention is not 
limited to this. The screens have tabs 301a to 301d for 
selecting the screen, and shift to the desired screen among 
the screens shown in Figs. 7 to 10A by clicking the desired 
tab . 

[0043] A schematic printing sequence according to the 
printing processing application is as follows. 

(1) First, a used printer or sheet is set on the sheet 
selecting screen. 

(2) A desired moving image file is selected on the 
moving image selecting screen. 

(3) A desired range of the moving image file selected 
on the moving image selecting screen is set on the range 
setting screen. It is confirmed whether or not the range 
set by the preview of the turning moving-image is proper. 

(4) A predetermined number of continuous still images 
are generated, on the printing and storing screen, from the 
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desired range set on the range setting screen, and the 
generated continuous still images are outputted by the set 
printer . 

[0044] Hereinbelow, the operations are described in 
detail on the screens. 

[0045] First, a description is given of the sheet 
selecting processing which is executed on the displayed 
sheet selecting screen with reference to Figs. 3 to 7 . Fig. 
3 is a flowchart for explaining the processing executed when 
the sheet selecting screen is selected. 

[0046] In step S101, a selected printer name is inputted 
to a box 310, and the printer selection is promoted to the 
user. An available printer list is displayed by clicking a 
"V portion" on the left of the box 310. The user can select 
the desired printer from the printer list. When only a 
single available printer exists, the printer is displayed on 
the box 310. Incidentally, the available printer means is a 
printer corresponding to the printing application while the 
printer driver 112 is installed to the information 
processing device 100. Upon starting the printing 
application, it is assumed that the selected printer is one 
selected at the previous end timing. 

[0047] In step S102, a cartridge is selected by using a 
box 311. In step S103, the sheet is selected by using a box 
312. According to the embodiment, the sheet size is fixed 
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to A4 one. However, a desired sheet size may be selected. 
[0048] In step S104, it is determined whether or not any 
of the tabs (301b to 301d) for shifting to another screen is 
selected. If NO in step S104, the processing sequence 
returns to step S101. If YES in step S104, the processing 
sequence advances to step S105 whereupon the setting 
contents on the boxes 310 to 312 at this timing are 
determined as the setting contents. Obviously, the setting 
contents can be changed by selecting the tab 301a from 
another screen later and by displaying the sheet selecting 
screen . 

[0049] Next, a description is given of processing for 
selecting the moving image which is executed upon selecting 
the tab 301b and for shifting to the moving image selecting 
screen with reference to Figs. 4 and 8. Fig. 4 is a 
flowchart for explaining the processing which is executed 
when the moving image selecting screen shown in Fig. 8 is 
selected . 

[0050] In step S121, the selected file is opened by 
user's file opening operation. Here, a pop-up window (not 
shown) for selecting the file is displayed in accordance 
with the click operation of an "open" button 321 and the 
user selects the desired moving image file by using the pop- 
up window. 

[0051] In step S122, it is determined whether or not the 



moving image file designated in step S121 is formed and is 
stored on the printing processing application. The printing 
processing application stores information for printing the 
continuous still images in step S169 in "printing and 
storing" processing shown in Fig. 6, as will be described 
later. If it is determined in step S122 that the 
information file is selected, moving image reading 
processing, which will be described later, is not performed 
and then the processing sequence shifts to step S126. The 
determination in step S122-is performed by referring to file 
extensions . 

[0052] As will be described later, the information file 
stores an image file name and a range for cutting out the 
still image (moving image frame range and trimming area) . 
According to the embodiment, the screen is automatically 
switched to the printing and storing screen so as to 
promptly execute the printing operation upon opening the 
information file. That is, upon opening the information 
file on the moving image selecting screen, the processing 
sequence skips a step of reading the moving image and jumps 
to the printing and storing screen (jumping processing is 
not shown on the flowchart) . When the above structure is 
not used and the information file is selected, the moving 
image may be read similarly to the case of normally 
selecting the moving image file. 



[0053] When the file selected in step S121 is the moving 
image file which can be processed by the printing 
application, the processing sequence advances to step S123 
whereupon the image at the head frame of the moving image 
file is displayed on a moving image reading area 323 in the 
moving image reading window 322. 

[0054] The moving image reading window 322 comprises user 
interfaces having a reading button 324 for instructing the 
start of reading processing of the selected moving file, a 
temporary stop button 325 for instructing the temporary stop 
and the cancel thereof in the reading processing, a stop 
button 326 for stopping the reading processing, a moving 
button 327 for movement to the head of the moving image, a 
moving button 328 for movement to the last moving image file, 
and a seek bar 329. The display portion is moved to an 
arbitrary position in the moving image file by drugging the 
seek bar 329. During reading the moving image, the seek bar 
329 is moved in accordance with the reading position. Time 
indication 330 indicates the position which is currently 
read by time from the start of reading. 

[0055] When the reading operation of the moving image is 
instructed by operating the reading button 324, the 
processing sequence advances to step S125 from step S124. 
In step S125, the moving image file selected in step S121 is 
read. A detailed description and flowcharts are not given 



of the operating processing of another operation button, and 
contents thereof will apparently be understood by those in 
the art. 

[0056] Upon selecting any of the tabs 301a, 301c, and 
301d for shifting to another screen while the moving image 
file is selected, the moving image file designated by the 
moving image file or the information file is determined as 
the moving image file, the processing ends, and the screen 
shifts to the designated screen (steps S126 and S127) . Upon 
selecting no tabs, steps S121 to S125 are repeated. 
Obviously, the determined contents can be changed by 
selecting the tab 301b from another screen later and by 
displaying the moving image selecting screen. Next, a 
description is given of the range setting processing which 
is executed upon selecting the tab 301c and shifting to the 
range setting screen with reference to Figs. 5A, 5B, and 9A 
and 9B. Fig. 5A is a flowchart for explaining the 
processing which is executed when the range setting screen 
shown in Fig. 9A is selected. A desired range (referred to 
as a range for cutting out the still image) is set from the 
moving image file as a target of the continuous still images. 
[0057] Referring to Fig. 9A, the range setting screen 
displays the moving image reading window 340 including the 
moving image area 323 for reading the selected moving image 
file, the various operation buttons 324 to 328, and the seek 



bar 32 9. The moving image reading window 34 0 on the range 
setting screen includes a start point button 341 and an end 
point button 342 for setting the range for cutting out the 
desired still image from the moving image, and a preview 
button 343 for previewing, as the turning moving-image, the 
continuous still images obtained from the setting range for 
cutting out the still image. 

[0058] The moving image reading processing in steps S141 
to S143 is the same as that in steps S123 to S125. That is, 
the image of the head frame in the moving image file 
selected on the moving image selecting screen is displayed 
on the moving image reading area (step S141) . The reading 
button 324 is clicked (step S142). Thus, the moving image 
file starts to be read (step S143) . 

[0059] When the start point button 341 is clicked during 
reading the moving image file, the reading time is 
registered as the start point of the range for cutting out 
the still image (steps S144 and S145) . When the end point 
button 342 is clicked, the reading time thereof is 
registered as the end point of the range for cutting out the 
still image (steps S146 and S147) . When the start point and 
the end point are registered, referring to Fig. 8, the 
selecting range can be identified by changing a display 
color of a portion corresponding to the selecting range of 
the seek bar 329 so as to indicate the selecting range for 



cutting out the still image. 

[0060] The desired range of the moving image is 
determined by designating the start point and end point 
during reading the moving image file. However, the present 
invention is not limited to this. The start point of the 
range for cutting out the still image may be designated by 
moving the seek bar 329 to the desired reading position and 
by clicking the start point button 341. Similarly, the end 
point of the range for cutting out the still image may be 
designated by clicking the end point button 342. In this 
case, the moving image file does not need to be read by the 
reading button 324. However, the frame image corresponding 
to the position designated by the seek bar 329 must be 
displayed at the moving image reading area 323. 
[0061] The range of the still image may be cut out by 
combining a method for designating the range for cutting out 
the still image during reading the moving image and a method 
for designating the range for cutting out the still image by 
using the seek bar 329. The operation of the seek bar 329 
enables the movement to the desired position in the moving 
image data, and the start point in the range for cutting out 
the still image is designated by clicking the start point 
button 341. After that, the moving image is read from the 
start point thereof by clicking the reading button 324 and 
the range for cutting out the still image is set by clicking 



the end point button 342 at the desired position. 
[0062] According to the embodiment, the start point and 
the end point in the range for cutting out the still image 
are registered by the reading time. However, the present 
invention is not limited this and the start point and the 
end point may be registered by using a frame number, etc. 
[0063] After determining the start point and the end 
point of the moving image file, in step S153, visual effects 
such as camera zoom-in/zoom-out and camera pan are used. 
Upon setting the visual effect, the processing sequence 
advances to step S154 from step S153 by pressing a visual 
effect button 400 shown in Fig. 9A. In step S154, the user 
interface shown in Figs. 11 and 12 is displayed. The 
setting of the visual effect is performed by using the user 
interface . 

[0064] Referring to Figs. 11 and 12, upon setting the 
visual effect according to the embodiment, interfaces for 
setting the trimming areas to a frame image (start image) 
corresponding to the start point registered in step S145 and 
to a frame image (end image) corresponding to the end point 
registered in step S147 are provided. The set trimming 
areas are enlarged or are reduced to the output size, and 
are printed, thereby obtaining the visual effect of the 
zoom-in/zoom/ out or camera pan of the moving image with 
small movement. 



[0065] Upon setting the trimming areas of the start image 
and the end image, the operability is improved so as to 
visualize which visual effect is obtained by a trimming 
method by providing guide buttons 501 to 507 on the top in 
Figs. 11 and 12. 

[0066] Fig. 11 is a diagram showing a setting example of 
the visual effect of the camera zoom-in. The pressing 
operation of the guide button 502 at the second position 
from the left sets defaults on the entire trimming area of 
the start image and in the center of the trimming area of 
the end image. In this case, when the trimming area on the 
end screen does not match the subject for the zoom-in, the 
position and the size can manually be adjusted. 
[0067] In the setting, the proportional trimming area of 
the frames from the start screen to the end screen is 
calculated and the still image is cut out. Referring to Fig 
13A, when the trimming area of the start screen (first 
image) corresponds to the entire screen (Hi x Vi) and the 
trimming area of the end screen (N-th image) corresponds to 
(H N x v N ) , the vertical size and the horizontal size of the 
trimming area are changed by (V 1 - V N ) /N and (H x - H N ) /N 
(where symbol N denotes the number of continuous still 
images), respectively. As a result, the "turning moving- 
image", e.g., a zoom-in image of a dog is enjoyed. 
[0068] When the position of the trimming area on the end 



screen is moved, the center position of the trimming area is 
deviated from the screen center. Therefore, the center 
position of the trimming area on the still image may be 
determined by equally dividing the amount of deviation by 
the number N of the continuous still images. The shift of 
the center position of the trimming area will be described 
later with reference to Fig. 13B. 

[0069] The guide button 503 at the third position from 
the left is a button for setting the default of the zoom-out. 
By pressing the guide button 503, the defaults are set to 
the trimming area in the center of the start screen and to 
the trimming area on the entire end screen. In the setting, 
the still images are cut out and, then, the "turning moving- 
image", e.g., a zoom-out image of the dog is enjoyed. 
[0070] Fig. 12 is a diagram showing a setting example of 
the visual effect of the camera pan. The defaults are set 
to the trimming area on the left of the start screen and to 
the trimming area on the right of the end screen, by 
pressing the guide button 504 at the fourth position from 
the left. In this case, when the trimming areas on the 
start screen and the end screen do not match the target 
subject, the position and the size can manually be adjusted. 
[0071] In the setting, the proportional trimming position 
and size are calculated in the frames from the start screen 
to the end screen. Referring to Fig. 13B, when it is 
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assumed that the center position of the trimming area on the 
start screen is designated by (Xi, Y x ) and the center 
position of the trimming area on the end screen is 
designated by (X N , Y N ) , a center position (X n , Y n ) of the 
trimming area of an n-th still image is expressed by (Xi + n 
x (X N - Xi)/N f Yi + n x (Y N - Y x )/N). When the size is 
further changed, it may be changed by the above method shown 
in Fig. 13A. For example, when the trimming area on the 
start screen is (Hi x v x ) and the trimming area on the end 
screen is (H N x V N ) , the trimming area of the n-th still 
image is set in the vertical direction and in the horizontal 
direction with size of (Hi + n x (H N - Hi) /N, Vi + n x (V N - 
Vi)/N). In the above setting of the trimming areas, the 
still images are cut out and, thus, the "turning moving- 
image", e.g., a camera-pan image from a girl on the left to 
a dog face on the right is enjoyed. 

[0072] The guide button 505 at the fifth position from 
the left is a button for setting the default of the camera 
pan from the right to the left. By pressing the guide 
button 505, the defaults are set to the trimming area on the 
right of the start screen and to the trimming area on the 
left of the end screen. In the setting, the still images 
are cut out and, thus, the "turning moving-image", e.g., a 
camera-pan image from the right to the left is enjoyed. 
[0073] The guide button 506 at the sixth position from 
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the left is a button for setting the default of the camera 
pan from the top to the bottom. By pressing the guide 
button 506, the defaults are set to the trimming area on the 
top on the start screen and to the trimming area on the 
bottom of the end screen. In the setting, the still images 
are cut out and, thus, the "turn moving image", e.g., an 
image of the camera pan from the top to the bottom is 
enjoyed. 

[0074] The guide button 507 at the seventh position from 
the left is a button for setting the default of the camera 
pan from the bottom to the top. By pressing the guide 
button 507, the defaults are set to the trimming area on the 
bottom of the start screen and to the trimming area on the 
top of the end screen. In the setting, the still images are 
cut out and, thus, the "turning moving- image " , e.g., an 
image of the camera pan from the bottom to the top is 
enjoyed. 

[0075] The leftmost guide button 501 is pressed, thereby 
returning the trimming areas on the start screen and the end 
screen to the entire screen. 

[0076] According to the embodiment, when the two trimming 
areas are set on the start screen and on the end screen of 
the continuous still images and the positions and/or sizes 
of the two trimming areas are different from each other, 
they are linearly changed. However, the present invention 
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is not limited to this. For example, the turning moving- 
image may largely be changed on the start side and it may 
not be changed so largely on the end side. Alternatively, 
the turning moving-image may largely be changed on the end 
side and it may not be changed so largely on the start side. 
That is, referring to Fig. 14A, the image may linearly be 
changed as shown by a straight line A from the size in the 
trimming area designated by the first still image to the 
size in the trimming area designated by the N-th still image. 
Alternatively, the change speed of the size may be changed 
as shown by a curve B and a curve C. For example, in the 
case of setting the curve B, the end portion of the turning 
moving-image is acceleratively zoomed. Referring to Fig. 
14B, similarly, the size may be set as shown by a straight 
line A 1 or it may be set as shown by a curve B 1 or C. For 
example, in the setting of the curve C, the position of the 
trimming area is changed at a high speed in a start portion 
of the turning moving-image and it is changed at a low speed 
in an end portion thereof. 

[0077] For the change of the changing speed of the size 
and of that of the position, an interface for selecting any 
of the straight line A and the curves B and C every size and 
every changing speed may be provided. Alternatively, the 
user may desirably set a curve. Obviously, those in the art 
will understand the above interface. 



- 25 - 



10 



[0078] In the foregoing, the trimming areas are set to 
the start screen and the end screen. However, an arbitrary 
position may be set in the continuous still images. For 
example, the trimming area can be set by using a tenth still 
image and a thirtieth still image. In this case, the first 
trimming area (trimming area set to the tenth still image) 
is set on the screens (e.g., first to ninth still images) in 
front of the screen to which the first trimming area is set. 
The last trimming area (trimming area set to the thirtieth 
still image) is set to the screens (thirty-first to forty- 
fifth still images) at the back of the screen to which the 
last trimming area is set. 

[0079] Further, a description is given of the setting of 
the above visual effect with reference to a flowchart shown 
in Fig. 5B. In step S201, it is selected which visual 
effect is used. If the guide button 502 is selected, the 
visual effect is the zoom-in and the processing sequence 
shifts to step S204 to step S205. In step S205, referring 
to Fig. 11, the defaults are set to the trimming area of the 
entire start screen and to the trimming area in the center 
of the end screen. In this case, when the trimming area on 
the end screen does not match the subject for the zoom-in, 
the position and the size are manually adjusted. 
[0080] Upon selecting the guide button 503, the zoom-out 
25 is obtained as the visual effect and the processing sequence 
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shifts to step S207 from step S206. In step S207, the 
defaults are set to the trimming area in the center of the 
start screen and to the trimming area of the entire end 
screen. In this case, when the trimming area on the start 
screen does not match the subject for the zoom-in, the 
position and the size are manually adjusted. 
[0081] Upon selecting the guide button 504, the camera 
pan from the left to the right is obtained as the visual 
effect and the processing sequence shifts to step S209 from 
step S208. In step S209, the defaults are set to the 
trimming area on the left of the start screen and to the 
trimming area on the right of the end screen. Referring to 
Fig. 12, the trimming areas are set. 

[0082] Upon selecting the guide button 505, the camera 
pan from the right to the left is obtained as the visual 
effect and the processing sequence shifts to step S211 from 
step S210. In step S211, the defaults are set to the 
trimming area on the right of the start screen and to the 
trimming area on the left of the end screen. 
[0083] Upon selecting the guide button 506, the camera 
pan (tilt) from the top to the bottom is obtained as the 
visual effect and the processing sequence shifts to step 
S213 from step S212. In step S213, the defaults are set to 
the trimming area on the top of the start screen and to the 
trimming area on the bottom of the end screen. Thus, an 



interface similar to that shown in Fig. 11 or 12 indicates 
the screen. 

[0084] Upon selecting the guide button 507, the camera 
pan from the bottom to the top is obtained as the visual 
effect and the processing sequence shifts to step S215 from 
step S214. In step S215, the defaults are set to the 
trimming area on the bottom of the start screen and to the 
trimming area on the top of the end screen. Thus, an 
interface similar to that shown in Fig. 11 or 12 indicates 
the screen. 

[0085] Upon selecting the guide button 501, the 
processing sequence shifts to step S203 from step S202. In 
step S203, the trimming areas are set to the entire start 
image and the entire end image and the processing sequence 
return to the initial state. 

[0086] After setting the trimming areas, as mentioned 
above with reference to Figs. 13A and 13B, the trimming 
areas of N frames are determined (step S216) . 
[0087] On the printing processing application according 
to the embodiment, a predetermined number of continuous 
still images (assumed that 45 continuous still images 
according to the embodiment) are cut out from the range for 
outputting the still image as set above and the cut-out 
still images are printed out. The thus-obtained printed-out 
continuous still images are detached like the oblong cards 
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and are observed as the turning moving-image by continuously 
turning the still images. To accomplish the foregoing, 
preferably, the continuous still images are previewed so as 
to observe the pseudo turning moving-image. Hereinbelow, a 
preview function for realizing the foregoing is realized in 
steps S148 to S150. 

[0088] After setting the range for cutting out the still 
image by the start point and the end point as mentioned 
above, a preview button 343 is clicked and thus the 
processing sequence advances to step S149 from step S148 
(incidentally, only when the range for cutting out the still 
image is set, the processing sequence advances to step S149) 
[0089] In step S14 9, the predetermined number of 
continuous still images is generated and is obtained from 
the setting range for cutting out the still image. In this 
case, the continuous still images are generated so that they 
are adjacent thereto at the same time interval 
(corresponding to the same number of frames) . That is, the 
frames are extracted from the setting range for cutting out 
the still images at the same interval and the continuous 
still images are generated from the extracted frames. 
[0090] The frames are extracted in step S149 by using the 
following expression. 

m = 1 + lNT((n - 1) x (M - 1)/(N - 1) + 0.5) 
25 Here, reference numeral INT(x) denotes a function for 
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obtaining numbers by omitting the figures after the decimal 
fractions, 

where M: number of frames in the selecting range, 
N: number of extracted frames (N > 1, N is fixed to 45 
according to the embodiment), 

n: frame ordering number (1 to N) , and 
m: extracted frame number (1 to M) 

(reference numerals M, N, n, and m denote all integers) . 
In the following expression, when M = (N - 1) x y + 1 . (y i s 
an integer which is not less than 1, all the intervals of 
the frames are equal. 

[0091] The trimming areas determined in step S216 are 
obtained from the frames extracted as mentioned above. The 
size of the obtained trimming area is changed to the 
predetermined frame size. 

[0092] In step S150, the continuous still images 
generated in step S149 are sequentially displayed in the 
image pick-up order so that 45 continuous still images end 
to be displayed for 2 sec. In this case, an interval for 
switching from one still image to another still image is set 
to be constant (e.g., 2/45 sec when the 45 continuous still 
images are displayed for 2 sec) . 

[0093] When the preview button 343 is clicked without 
changing the selecting range of the moving image, the 
continuous still images have already been generated. Thus, 
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the processing in step S149 is omitted. 

[0094] When this state is maintained and the tabs 301a, 
301b, and 301d corresponding to other operating screens are 
clicked, the processing sequence advances to step S152 from 
step S151. In step S152, the setting range for cutting out 
the still image is determined. Of course, the determined 
contents can be changed by selecting the tab 301c from 
another screen and by displaying the range setting screen. 
When the tab corresponding to another operating screen is 
not clicked, the above processing is repeated. Consequently, 
the processing sequence returns to step S141. According to 
the embodiment, since the preview contents are displayed and 
the range is set on the single screen (range setting screen), 
the turning moving-image is confirmed by the preview and 
then the range is set again, thereby improving the 
operability . 



[0095] As mentioned above, the visual effects such as the 
camera pan, the tilt operation, and the zoom operation are 
confirmed . 

20 [0096] On the preview display of the continuous still 

images in step S150, the display time may arbitrarily be set 
by providing a preview setting panel 344 as shown in Fig. 9B. 
For example, as shown by a portion 345 in Fig. 9B, the 
entire display time can arbitrarily be set and the setting 

25 is performed so that the image is displayed for one sec. 



Then, the continuous still images are switched and are 
displayed at a time interval of 1/45 sec. Further, as shown 
by a portion 346 in Fig. 9B, the interval for switching the 
continuous still images may be designated (e.g., the 
continuous still images are switched at a time interval of 
0.04 sec) . 

[0097] As shown by a portion 347 in Fig. 9B, the manual 
operation may be possible. In the example, a slide bar 348 
is displayed and a knob 349 is slid by a mouse. Then, in 
accordance with the above operation, the continuous still 
images are switched and are displayed. With the structure, 
the switching interval which is constant and fixed in the 
continuous display operation can be changed in the above- 
mentioned portions 345 and 346. The accurate preview can be 
displayed by the user's turning operation. 
[0098] Next, a description is given of processing when 
the tab 301a is selected and the screen shifts to the 
printing and storing screen. Fig. 6 is a flowchart for 
explaining the processing which is executed when the 
printing and storing screen shown in Fig. 10A is selected. 
On the printing and storing screen, it is possible to print 
the continuous still images obtained from the range for 
cutting out the still image set on the range setting screen 
and to store the cut-out information. 

[0099] In step S161, it is determined whether or not the 
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processing for converting the still image of the currently- 
set cutting-out target in step S149 is performed. If YES in 
step S161, the continuous still images of the range for 
cutting out the still image are obtained and thus the 
processing sequence skips step S162. If NO in step S161, 
the processing sequence advances to step SI 62 whereupon a 
predetermined number of continuous still images are cut out 
from the range for cutting out the still image which is set 
on the range setting screen. The processing in step S162 is 
the same as that in step S149 in Fig. 5. 
[0100] In step S163, a printing layout 351 of the 
generated continuous still images is displayed. According 
to the embodiment, 15 continuous still images are printed on 
each A4-size sheet and thus the total three pages are 
printed. Therefore, a next-page button 356 or a previous- 
page button 355 is provided and they are operated, thereby 
confirming the printing layout 351 of all pages. 
Incidentally, numbers described in the continuous still 
images shown in Figs. 10A and 10B are conveniently 
designated because they indicate the continuous still images 
(that is, the images are not the same one) . 

[0101] The printing setting button 353 is clicked, then, 
it is determined that the printing setting is changed, and 
the processing sequence advances to step S165. In step S165, 
a screen for inputting the printing setting (not shown) is 
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displayed and the following printing setting indexes are se 
[0102] <Layout> 

• Right bind: Print with left-handed layout. 

• Left bind: Print with right-handed layout. 
("Left bind" in the case of a default) 

[0103] <Background> 

• No: Print no data around the continuous still images. 

• Black gradation: Print black gradation changing from 
the continuous still images to the margin around the 
continuous still images. 

• Designated-color gradation: Print gradation of 
designated color changing from the continuous still images 
to the margin around the continuous still image. 

("Black gradation" in the case of the default) 
[0104] <Title> 

• No: Print no title. 

• Print title: Print an inputted character string as a 
title (it is possible to set whether the title is printed on 
only the first page or on all the pages). 

("No" in the case of the default) 
[0105] <Photographing date> 

• No: Print no photographing date. 

• Print date: Print the photographing date (it is 
possible to set whether the photographing date is printed on 
only the first page or on all the pages). 
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("No" in the case of the default) 
[0106] After setting the printing, the processing 
sequence returns to step S163 whereupon the printing layout 
is displayed on the updated printing setting. The change of 
the printing setting is directly reflected to the display 
for the printing layout. 

[0107] The printing button 352 is clicked and, then, the 
processing sequence advances to step S167 from step S166 
whereupon the continuous still images are printed on the 
designated printer as shown in Fig. 10B. With respect to 
the printing image in this case, the continuous still images 
are cut out from the moving image and are obtained by 
extracting the trimming areas, and the aspect ratio of the 
continuous still images is fixed. In this case, the 
continuous still images have the fixed aspect ratio and the 
reduced size included in an area of (42 mm x 34 mm) . Then, 
the obtained continuous still image is printed. The 
printing quality is a default one of a designated medium. 
When the background has the designated index, the background 
is printed to satisfy the designated index. When it is 
designated that the photographing date or the title is 
printed, it is printed in accordance with the designation. 
In order to clearly indicate the order of the continuous 
still images, numbers are printed to the margin on the side 
of the continuous still images (at the position on the upper 



right corner in the case of the right bind or at the 
position on the upper left corner in the case of the left 
bind according to the embodiment) (in an example of the 
right bind shown in Fig. 10B in which page numbers are 
printed on the upper left corner) . 

[0108] A storing button 345 is clicked and, then, the 
processing sequence advances to step S169 from step S168. 
In step S169, one file is stored, including the indexes set 
on the sheet selecting screen, moving image selecting screen, 
range setting screen, and printing and storing screen 
(printing setting) . For example, the storing index includes 
a used printer, information on the cartridge, sheet, moving- 
image file name, start position for cutting out the still 
image, end position for cutting out the still image, 
designation of the trimming area, and the contents for the 
printing setting (layout and background) . However, the data 
on the continuous still images is not stored. 
[0109] The 45 thus-obtained continuous still images are 
printed on the sheet having the perforation as shown in Fig. 
10A. The continuous still images are detached to the sheets 
like the oblong cards along the perforation and are bound. 
The bound images are continuously turned as shown in Fig. 15 
and, thus, the turning moving-image is observed. 
[0110] As mentioned above, on the printing processing 
application according to the embodiment, it is possible to 



print out the continuous still images in the desired range 
of the moving image data which can be observed as the 
turning moving-image. The user's desired turning moving- 
image can easily be provided. 

[0111] In particular, it is possible to provide the 
turning moving-image having the camera pan, the camera tilt 
operation, and the camera zoom-in/zoom-out operation as the 
visual effects in accordance with the user's desire by 
setting the trimming areas in the continuous still images. 
Consequently, the visual effects such as the camera zoom- 
in/zoom-out operation and the camera pan are obtained in the 
moving image with the small movement and, advantageously, 
the turning moving-image is enjoyed. 

[0112] In the preview function using the preview button 
343 on the range setting screen as shown in Fig. 9A, the 
continuous still images which are cut out from the 
designated range are continuously switched and displayed. 
Thus, conveniently, the user can confirm the observing state 
of the turning moving-image by binding the continuous still 
images and by continuously turning them. When the user does 
not desire the turning moving-image, the range for cutting 
out the still image is promptly designated again without 
switching the window and the operability is improved. 
[0113] Further, when the switching interval of the still 
images can be set in the preview function, the preview 



operation is performed in accordance with the user's desired 
turning speed. In addition, with the structure for 
controlling the switching operation of the continuous still 
images synchronously with the movement of the knob 348 of 
the scroll bar 348, the interval of the display switching 
can be changed during displaying the continuous still images 
Thus, the preview function is realized in accordance with 
the user's way upon observing the turning moving-image (e.g. 
the speeds at the turning start and the turning end are 
slower than those of other portions) and the turning moving- 
image is previewed with more accuracy. 

[Other embodiments] 
[0114] The present invention can be applied to a system 
comprising a plurality of devices (for example, a host 
computer, an interface device, a reader, and a printer) or 
to an apparatus comprising a single device (for example, a 
copying machine or a facsimile machine) . 

[0115] Obviously, the objects of the present invention 
can be accomplished by supplying to the system or apparatus, 
a storage medium for storing software program code to 
implement the functions of the information processing 
apparatus and the image output device according to the 
embodiment, and by reading out and executing the program 
code which is stored in the storage medium by a computer 
(CPU or MPU) of the system or apparatus. 
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[0116] In this case, the program code itself which is 
read out from the storage medium implements the function of 
the foregoing embodiment and the storage medium which stores 
the program code constructs the present invention. 
[0117] As for the storage medium to supply the program 
code, it is able to use a floppy disk, hard disk, optical 
disk, magneto-optical disk, CD-ROM, CD-R, magnetic tape, 
nonvolatile memory card, ROM, and the like. 
[0118] Obviously, the functions of the aforementioned 
embodiment can be effected not only by executing the program 
code which is read out by the computer, but also by 
executing a part or all of the actual processing on the OS 
(Operating System) which operates on the computer based on 
the instruction of the program code. 

[0119] According to the present invention, the continuous 
still images are generated by using the trimming areas to be 
extracted from the frames. 

[0120] While the present invention has been described 
with reference to what are presently considered to be the 
preferred embodiments, it is to be understood that the 
invention is not limited to the disclosed embodiments. On 
the contrary, the invention is intended to cover various 
modifications and equivalent arrangements included within 
the spirit and scope of the appended claims. The scope of 
the following claims is to be accorded the broadest 
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interpretation so as to encompass all such modifications and 
equivalent structures and functions. 



